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Abstract. We introduce a modification of Voiculescu's free entropy which co- 
incides with the hm inf variant of Voiculescu's free entropy on extremal states, 
but is a concave upper semi-continuous function on the trace state space. We 
also extend the orbital free entropy of IHMUl to non-hyperfinite multivariables 
and prove freeness in case of additivity of Voiculescu's entropy (or vanishing 
of our extended orbital entropy) . 



1. Introduction 

Voiculescu has introduced a free entropy quantity, for tracial states on a von 
Neumann algebra generated by n self-adjoint elements, which has been very useful 
for the solution of many long standing open problems in von Neumann algebra 
theory. It turns out that free entropy satisfies an unusual property for an entropy 
quantity which is a "degenerate convexity" property, i.e. the entropy of any nonex- 
tremal state is — oo, which is in sharp contrast with the usual concavity and upper 
semi-continuity property of classical entropy. Recently Hiai [H] defined a free ana- 
logue of pressure and considered its Legendre transform. He obtained a quantity 
which is concave and upper semi-continuous, and majorizes Voiculescu's free en- 
tropy. It is not clear whether this quantity coincides with Voiculescu's free entropy 
on extremal states. In this paper we introduce a modified definition, through ran- 
dom matrix approximations, which yields a quantity which is both concave upper 
semi-continuous, and coincides with the liminf variant of Voiculescu's free entropy 
on extremal states. Our main argument is the simple observation that a probability 
measure on a compact convex set, whose barycenter is close to an extremal point, 
has most of its mass concentrated near this point (see Lemma 16.11 below) . This 
is obvious in finite dimension, but requires further clarification in infinite dimen- 
sion. In this paper we rely on the fact that the convex set we consider is a Poulsen 
simplex. 

We use an analogous idea to generalize the definition of free orbital entropy, 
due to Hiai, Miyamoto and Ueda |H]V[U| . In this paper, the authors introduced, 
via a microstates approach, an entropy quantity Xorbi^i, ■ ■ ■ , Xn), where each Xi 
is a finite set of noncommutative random variables generating a hyperfinite algebra. 
They used this quantity to generalize Voiculescu's additivity result f |V4| ). namely : 
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for noncommutative random variables Xi, . . . , Xn, if 

xix,,...,x,,) = x{x,) + ... + x{Xn) 

and these quantities are finite, then the Xi are free. More generally, they showed 
that XorbO^i, ■ ■ ■ , X„) = is equivalent to freeness in the hyperfinite context above 
even though the finiteness of entropy fails in general in this case. They recover the 
previous result since they also show : 

X{Xi, . . . , X„) = XorbiXi,. ..,Xn) + xiXl) + ...+ xiXn), 

in case these quantities are finite. 

In section 7, we introduce ci definition of ^or6(^i; ■ ■ • ? 

), for arbitrary finite 

sets Xi of noncommutative random variables, obtained by replacing microstates 
by probability measures. We show that many of the arguments of |H]V[U| have 
analogues in this setting, and we obtain the full generalization of the additivity 
result when random variables Xi are replaced by arbitrary finite sets X^. 

This paper is organized as follows. We start by recalling some well known 
facts on trace states and on Legendre transform and classical entropy (including 
Csiszar's projections result) in section 2 and 3. Then we prove the main result about 
concavification in section 4 and 6, after a few preliminaries about Poulsen simplices 
in section 5. In section 7 we extend the definition of orbital entropy, and prove 
freeness in case of additivity of Voiculescu's entropy, in Corollarv l7.4l Finally, after 
a few more preliminaries in section 8, section 9 is devoted to some further variants 
and extensions of our definitions, which might prove useful for future applications. 

Acknowledgments : The authors want to thank respectively U. Haagerup 
and D. Shlyakhtenko for fruitful discussions. The authors are grateful to the Er- 
win Schrodinger Institute where part of this work has been completed. They also 
thank the organizers of the workshop on "Random Matrix, Operator Algebra, and 
Mathematical Physics Aspects" in the semester on Bialgebras in free Probability 
having taken place there. Finally we would like to thank an anonymous referee for 
some very helpful comments and suggestions. 

2. The set of trace states 

Let C{Xi, . . . , Xn) be the free *-algebra with unit generated by n> 1 self- 
adjoint elements Xi, . . . , A„, which we identify with the space of noncommutative 
polynomials in the indeterminates Xi,. . . , A„. We consider the set 5" of trace 
states on C(Ai, . . . , A„). This set consists in all positive, tracial *-linear maps 
r : C{Xi, . . . , Xn) C such that r(l) = 1 and, for any P e C(Ai, . . . , A„) there 
exists some constant Rp > such that 

(2.1) r((P*P)'=) < Rf for fc > 

Let us denote by the set of all trace states such that ma.x{Rxi , Rx„) ^ 

Especially, for i? > T we have 5]^ D S^. Moreover, = Ur>oS^. Finally for 
T G 5", we define TZ{t) = inf {i?,T e S^^} so that obviously t e S^^^)- 

The set can be identified with the set of trace states on the free product C*- 
algebra *"^]^C([— i?, i?]), cf [H]. It is a compact convex set for the weak* topology. 
By the reduction theory for von Neumann algebras, it is a Choquet simplex, and its 
extreme points (for n > 2) are the factor states [T]. Note that, as a consequence, 
an extreme point in is still an extreme point in for T > R. Moreover, 
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the second author proved in (DJ Corollary 5] that, for n > 1, is a Poiilsen 
Simplex, i.e. the unique metrizable Choquet simplex with a dense set of extreme 
points (cf. |LOS| ). If ^ is a von Neumann algebra equipped with a tracial state 
(p, and {Xi, . . . ,Xn) G A an n-tuple such that supj \\Xi\\ < R, one defines a state 
TXi,...,x„ G by the formula 

Tx„...,xAP) = V^iPiXi,...,X^)). 

In particular, if ^ = il/Ar(C) and f = jjTr the normalized trace, we denote by 
the set of hermitian matrices of size N, whose operator norm is less than R, then 
an n-tuple {Mi, . . . , M„) G (i?^)" defines a state tmi,....m„ G S^, by 

TA/i,...,M„(P) = ^Tr(P(A/i, . . . , A./„)). 

Similarly, a probability measure /i on {H§)^ (always assumed Borel) defines a 
random state in S^, whose barycenter t^, defined by 

r^{P) = / ^Tr(P(A/i, . . . , Mn))d^,{Mi, M„), 

is again an element of S^. 

For T G iS]^, let Ve.K{T) be the set of states a G 5]^ such that, for all monomials 
m of degree less than K , we have : 

|t (m(Xi, . . . , X„)) - a (m(Xi, . . . , X„)) | < e. 

The sets (ye^K{T);e,K > 0) form a basis of neighbourhoods of t in the weak* 
topology. 

3. Classical entropy, its Legendre transform and Csiszar's projection 

Recall that the entropy of a probability measure fj. on Rp is the quantity 
^ /rp /(^) log if ^(dx) = f{x)dx, log(/) e L^{fJ.) 

— oo otherwise 



Ent(^) 



The entropy is a concave upper semi-continuous function of fi. 

Moreover, there is also a well known notion of relative entropy of two probability 
measures (also called KuUback-Leibler divergence, cf. [K]). 



Ent(//|i^) = 



- /rp fi^) log f{x)diy{x) if n{dx) = f{x)dv{x), 

— oo if /i is not absolutely continuous with respect to u 



Note that, by Jensen inequality, Ent(/i|i^) < 0. The relative entropy satisfies the 
following key property: For any measurable map T, if T,/x is the pushforward 
measure of /i, we have (cf. [Kl Chap 2 Th 4.1]): 

(3.1) Ent (T*^i I T*i^) > Ent(^|i/). 

If i? C RP is a subset with positive Lebesgue measure, and /i is the normalized 
Lebesgue measure on E, then 

Ent(/x) = log(Leb(£;)). 
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Actually this is the maximum value of Ent on the set of all probability measures 
supported by E. Analogously, if ^ is the restriction of ly to E, renormalized into a 
probability measure, then 

Ent{^i\iy)^log{u{E))). 

and again this is the maximum value of Ent(.|i^) on the set of all probability mea- 
sures supported by E. From this we deduce the following estimates. 

Lemma 3.1. Let fi be supported by E and F d E a measurable subset, then 



Entifi) < fi{F)\ogLeb(F) + fi{E\F)\ogLeb{E\F) 
^ ' logM(F) - (1 - t^{F)) log(l - ^l{F)) 

and 

Entip\,y) < ^iiF)log,yiF)+^x{E\F)loglyiE\F) 
^ ' -m logniF) - (1 - ^^{F)) log(l - fi{F)). 

Proof. 

Ent(/i) = -Jp ,f{x) log f{x)dx - Jj^^p f{x) log fix)dx 

= -f^iF) U log {^dx - \ F) Jp^p log ^dx 

~fi{F) logA.(F) - liiE \ F) log^iiE \ F) 
< n{F) log Leb(F) + fi{E \ F) log Leh{E \ F) 

-/i(i^) log /.(F) - (1 - /t(F)) log(l - ^^{F)). 

The proof of the other inequality is similar (cf. (KJ Chap 2 Cor 3.2]). □ 

We shall need another characterization of entropy, through its Legendre trans- 
form. Indeed we have, for any probability measure fi supported by a set E, of finite 
Lebesgue measure, 



Ent(/i) = inf log / cxp (j)(x)dx — / (j)(x)fi(dx) 

where Ci,{E) is the space of bounded, real valued continuous functions on E. 
Likewise (see e.g. |DZ| section 6.2) for any probability measures /i, v supported on 
E, 



(3.4) Ent(/i|j/) = inf log / exp 4>{x)dv{x) ] - / (j){x)fi{dx) 

<peCi(E) \ \Je J Je 

It follows that if /i , . . . , /p are real valued bounded measurable functions on 
E, then we have 



(3.5) 



infAeRP (log /g e^.^'-'^'^^^da; - = 
sup |Ent(/i) I jj, supported on E; J fi{x)^i{dx) — ai,i — 1, . . . ,p} 



where the sup is defined as — oo if there is no such probability measure. 

We will apply these considerations to the case where the set is a product 
of balls H§, i.e. balls of radius R for the operator norm in the space of N x N 
hermitian matrices, with Lebesgue measure, and the functions /i, . . . , /p are traces 
of selfadjoint polynomials in noncommuting indeterminates, of the form 

/(Ml, . . . , A/„) = NTr{P{Mi, . . . , M„)). 
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Let US define 

iNiP) = / e-WTr(P(A/i,...,A/„))^^^^ ^j^^^^ 

for P a self- adjoint element of C(Xi,...,X„). 

Definition 3.2. For r g S^, we define pn,k{t) as the maximum of the entropy 
of (Borel) probability measures /x on whose barycenter coincides with r on 

monomials of degree less than K, and pn.k{t) = —oo if there is no such measure. 
Equivalently, if P[(H^)"] is the the above set of Borel probability measures, we 
have : 

Pn,k{t) = sup Ent{fi). 

MeP[(H^)"l 

We have, by : 
(3.6) PN,Kia)= inf (log /jv (P) + iW(P)) , 

P = P* ,dcg(P)<iC 

which is therefore a concave upper semi-continuous function of a. 

Even though we won't need it before section 9, it may be entlightening to use 
the language of Csiszar's I-projections (cf. |Cs| . see also jN] Chapter 10] for an 
exposition). Let us recall the basics. Let £ be a closed convex set of probability 
distributions then, by the strict concavity of relative entropy, there exists a unique 
probability measure realizing sup^g^ Ent(/i|i^). This probability distribution, de- 
noted C, is called Csiszar's Lprojection of the probability distribution v on the 
convex set £. Csiszar |Cs| first proved its existence when £ is variation closed and 
contains a fi with Ent(/i|i/) > —oo. Moreover C is characterized by : 

Ent(^|i/) < Ent(/i|C) +Ent(C|i^), 

for every /x G 5. We can infer from this that pn,k{t), if finite, is the entropy 
of Csiszar's I-projection CNfi,K[T) of normalized Lebesgue measure (on (H^)"-) 
on the set of measures whose mean agrees with r on monomials of order less 
than K. It is a well known result about exponential families (see e.g. |Csl 
Theorem 3.1] or jN] Theorem 10.2]) that C]s[.o,k{t) has a density with respect 
to normalized Lebesgue measure on (i?^)" of the form ■^e~'^^^^^^'''' for a non 
commutative polynomial V of degree less than K. Especially, pn,k{t) is the entropy 
of a well-studied unitary invariant random matrix model. 

4. Voiculescu's free entropy and its modification 

Let T G S"^, let e > be a real number and K, N be positive integers. We denote 
by rfl(r, e, K, N) the set of n-tuples of hermitian matrices Afi, . . . , l\In G such 
that for all monomials m{Xi, . . . , X„) = Xi^ . . . Xi^ of degree less than K we have : 

|r (m(Xi, . . . , X„)) - ^Tr {m{Mi, Af„)) I < e 

Equivalently Tfi{T, e, K, N) is the set of n-tuples of hermitian matrices Mi, . . . , M„ G 
whose associated state tmi,....m„ is in ^^^^(t). 

Definition 4.1. |V2| Define for t G : 

/ 1 ri 
XRir) = lim limsup — log (Leb(rii(T, e, i^, TV))) + -logA^ 

A— >-oo,£— >0 TV— >-oo V-'' ^ 
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The free entropy of a tracial state re 5" is 



X(r) 



sup Xr{t)- 

R>n(T) 



It is known that, if r is not an extreme point of S'^, then x{t) = — cxd, cf |V3| . 
Furthermore, if r is considered as a state in S^, for some R' > R > TZ{t) then 
%/?'(''") = Xr{t)- Since it is not known whether the Umsup in the definition is a 
limit, it has been useful to define : 

X^(r) = lim liminf (-^ log (Leb(rfl(r, e, i^, TV))) + ^logA^ 

and; for a nontrivial ultrafilter on N : 

X^(r) = lim lim f log (Leb(rfl(r, e, iV))) + ^\ogN 

In |V1| . a state r for which these limits coincide is called regular. 

We are now going to concavify the previous definition in the following way. 



by 



Definition 4.2. We define the concavified free entropy of a tracial state r £ 



lim lim inf 

A'— >oo,e— >0 N-^oo 



sup PN.K(cr) 



+ -logiV 



and likewise Xuij) with a lim sup and x'r(''") with a limit to cj. 
Finally, we put for t € S'^ : 



X{r) 



sup X (r) 

B>TZ{t) 



and likewise for x'^ (''')• 



We thus have, as for Voiculescu's free entropy, three variants, but we do not 
know whether they all coincide. Note that, since {fi S P[{H^)"] : G K_i<-(T)} = 
^aev^,K{r){f^ S P[{H§y"] : r^j g n,,>oK,,A'(o')}, we have the alternative formula : 



lim lim inf 

A-i.oo,e-i.O A-s-oo 



7V2 



sup Ent(/^) 



■logA^ 



We have the fundamental properties : 

Proposition 4.3. The quantity Xj^i^) concave upper semi-continuous 

function of t. So is x'r(''")- Furthermore, we have : 

and X-RjX'r '^'^^ subadditive: if ti,T2 are the marginal states giving the noncommu- 
tative distributions of Xi, . . . , Xm and Xm+i, ■ ■ ■ , Xn respectively, then 

XRir) < Xfl(n) + Xr{t2), XRir) < XRin) + ^^2)- 

Proof. According to p.6p . we have : 



inf 

J=eCj,„<Xi,...,x„> 

deg(P)<Jf 



{\0glN{P) + N^(T{P)) 
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which is therefore a concave upper semi-continuous function of a. Let ri and T2 be 
states, and let cri e Vc^k{ti), (J2 G Ve,K{T2), then 

Ao-i + (1 - A)cr2 e T4,a'(Ati + (1 - \)t2) 

therefore by concavity, 

sup Pn.k{(j) > >^Pn,k{(Ji) + (1 - >^)pn.k{(J2)- 

<j6V,(Ati+(1-A)t2) 

Since this is true for all cri , 172 we get : 

sup PN,Ki<j) > X sup pAr.if(cri) + (1 - A) sup PN,k{,CF2)- 

ctGV,(Ati + (1-A)t2) (Tiey,(ri) (T26V,(r2) 

The reader may have noted this is also a consequence of the expression of the 
left hand side as the entropy of Csiszar's I-projection on the set of measures having 
mean in Vi=^k{Xti + (1 — A)t2). Thus svcp^^y^ ^.^^-j pn.k{o') is a concave function of 
T, and taking a liminf we see that : 



liminf ( — 



sup PN.K{cr) 




IS again concave m r. 

It is easy to check that taking the limit as e goes to zero gives an upper semi- 
continuous function. Since it is nonincreasing in K, the limit as K — s- cx) is again 
concave and upper semi-continuous. 

Subadditivity follows from the subadditivity of classical entropy. Note that we 
cannot deduce it for the liminf variant, since in general the inequality liminf (a,i -|- 
bn) liminf(a„) -|- liminf(6„) fails. Of course if all variants of the free entropy 
actually coincide, subadditivity would follow in this case. □ 

Remark 4.4. We notice that the state of maximal x entropy in is the 
distribution of a free family of arc-sine distributed self-adjoint operators, where the 
arcsine distribution is on [—R,R\. It corresponds to taking the limit of barycenters 
of normalized Lebesgue measure on {H^y\ In particular, this quantity is finite. 
(The reader may also be referred to |HP| section 5.6 for this finiteness.) 



Remark 4.5. As the referee reminded us, Voiculescu suggested in |V2I section 
7.1] several alternative definitions of free entropy. We discuss here the relation with 
our definition. The first variant x^^H''') has been studied in [B] and the second 
variant x*-^'(t) happens to be by definition exactly our x{t). The first part of this 
paper may thus be seen as a study of this suggestion of Voiculescu. Recall the 
definition : 



X^^Hr) = sup 

R>K{t) 



K~ 



lim 



lim sup 

>0 Af^oo 



1 

7V2 



V 



sup 

E^A.\-^Tt{P)-t(P)\]<i 
VP monomial. d&g{P)<K 



Ent{p) 



-\ogN 
2 ^ 



In [B], Belinschi proved x'^^H''') = xi''')- for any t G 5". We want to point 
out that the nonlinearity of the condition in j^Tr{P) under law p is the key why 
this equality is valid here (as in Hiai's second variant of entropy jH] section 6]). 
In the variant x(t) we only have a condition on r^, and this allows us to get a 
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concavification,; this is also what makes it harder to prove equahty with %(''') i'l 
the factorial case. 

We may also compare our definition with the quantity obtained by m using 
the Legendre transform of free pressure. Define, for P ^ P* £ C{Xi, ...,X„} : 

1 n 
ttr{P) = limsup — log In (P) + 7: log A^- 

Hiai defines the entropy by : 

riRir)^ inf r(P)+7rfl(P). 

p=p*ec{Xi,...,x„} 

By p.Sp . for any P monomial of degree less than K, a G (t), we have : 
1 , ^ 1 

Thus, taking a supremum, a limsup (or liminf), and then the limit in e, K, we get : 

XBir) <T{P)+7rRiP), 
so that taking an infemum over P we also get : 

Xr{t) < Vr{t)- 

We don't know when there is actually an equality, but in the one variable case 
(n = 1), it is known rjnir) = x(t) and thus r/fj{T) = %(''') = x(t) = x(t) for R 
large enough. 

In this article, we mainly study Xpl''") instead of xi^)- This is motivated by 
the following result, really similar to |V2I Proposition 2.4]. 

Proposition 4.6. Consider t e S^. For any T > R> TZ{t) we have : 

Xrir) = Xj,{r) ^ xW, Xt{t) = XR{r) = x{t), X^{r) = xlir) = r{r). 

Proof. We only prove the liminf variant, and of course it will suffice to prove 
for T > R > TI{t), X^(t) < Xr{t) (the other inequality is obvious). Let 5* = 

^^'^2~^^ - Define the continuous piecewise linear function h : [— T, T] — > IR by h{t) = 
afor t e [-T, -R]U[R,T], h{t) = 1 for t e [-S,S], h{t) = a+(l-a)|ti| the linear 
interpolation for t E [— i?, —5] and h{t) = a + {l — a) ~R^g' , with a = 2T^(ji+s) ^ ^ 
since T > R. 

In this way, if we define a continuous increasing function g : [—T, T] — > [—R, R] 
by git) = -R + h{s)ds we have g{T) = R, g{t) ^ t for t e [-S, S] and g'{t) e 
Let also G : [HJjY' ^ defined by G(Ai,...,A„) = .9(A„)). 

Especially for a state r S 5^, we get a state G*r g 5]^, so that = G^,t^, 

defined by : 

(G*r)(P(Xi,...,X„))-r(P(5(Xi),...,5(X„))). 

Fix e > 0,K G IN*, r g S^, we will choose Si, S2 > small enough later. First, 
as in the proof of |V2l Proposition 2.4], we get < ei < e/2, Ki > K such that for 
any a € V^-^^KiiT) D (with E{Xj,B) the spectral projection of the self-adjoint 
element Xj (computed in its GNS representation) on the set B C IR) : 

aMX,) ~ X,\) < 52. 
This impHes G*cr e Ve,K{T D S^), for 82 small enough (e.g. 82 < e/2KT^-^). 
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Consider fi e P[{H§)"-] such that G Ve^.Ki{T), we can estimate by Cheby- 
shev's inequality : 



P^{-Tr{E{X,, [-T,-S]U[S,T])) > 82) < 



E^i^TriEiX,,[-T,-S]U[S,T])) 



<Si. 



We can also compute = o G^i) x \det{Jac{G-^))\. If we write dg 

the two variable function dg{A,B) = lg{A) - g{B))/{A - B),A^ B extended by 
dg{B,B) = g'{B) on the diagonal, the jacobian of g is given by dg applied by 
functional calculus so that : 

Ent{G,ii) = Entip) + ^ E^,{]^{Tr ® Tr){\og \dg{Xj ® 1, 1 » Xj)\^)). 
j 

In the proof of |V2i Proposition 2.4], Voiculescu showed that, for a matrix Xj e 
{H'^Y such that j^Tr{E{Xj, [-T, -5] U [S,T])) < 82, the positive determinant of 
the jacobian of g is bounded bellow so that : 

i(Tr ® Tr)(log \dg{X, ® 1, 1 X,)\^) 



< {N + ~ {Nil ~ S2)r)\\oga\ 



Moreover for any matrix Xj E {H^y^ . we have : 
iV2|loga|. 

As a consequence, we get : 



i(rr ® Tr) (log \dg{Xj®l,l®Xj)[^ 



< 



lim inf 

N—foo 



Ent{G^li) > Ent{n) - n{N + N'^{262 ~ Sl))\\oga\ - nSiN'^\loga\. 
Taking suprema and liminf, we get : 

pN,K{cr) 



sup 

e-P[(H«)"] 



TL 

+ -\ogN 



> liminf I — ^ 



sup PN,K{cr) 



+ log I + n{2S2 - log a + nSi log a. 



Since 61,62 can be made arbitrarily small choosing ei,Ki, we get the desired 
inequality. □ 

5. A preliminary separation result 

In order to prove that Voiculescu's entropy coincides with its modification on 
extremal states, we will need a separation result. We gather here references to the 
literature. Recall that for K a convex subset of the dual E* of a complex topological 
vector space, an x G is said to expose / in if if / £ AT and ^g{x) < for 
all g G K other than /. Those / which are so exposed by elements of E are weak-* 
exposed points of K. We now state a result of Sidney [S] (attributed by Asplund 
to Bishop in the Banach space case) 

Proposition 5.1. Let E be a separable Frechet space and K a non-empty 
convex weak* compact subset of its topological dual E* . Then K is the weak* closed 
convex hull of the set of its weak* exposed points (this set is thus non empty). 
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Since it is proved in ^ that is a Poulsen simplex, we will use the following 
result |LOS| of homogeneity. 

Proposition 5.2. Let Si and S2 he metrizahle simplices with Ext Si = 5*^ (i.e. 
Poulsen simplices), for i = 1,2. Let Fi he a proper closed face of Si, i = 1,2, and 
let Lp he an affine homeomorphism which maps F2 onto Fi . Then ip can he extended 
to an affine homeomorphism which maps S2 onto Si. 

Applying those two results, the second to move any extremal point to a weak-* 
exposed point, which exists via the first result, one easily gets : 

Proposition 5.3. Let E be a separable Frechet space and K a non-empty 
convex weak* compact subset of its topological dual E* , which is a Poulsen simplex. 
Then any extreme point of K is a weak* exposed point. 

Corollary 5.4. Let r be an extremal state in 5]^, n > 1, and e > 0. For 
any rj > 0, there exists a self adjoint polynomial G C{Xi, . . . , X„) .such that for 
every a e 5]^ we have : 

r{Qn) > cr{Q,j) - V, 
and for all a ^ V^.Kij) one has : 

Proof. Take rj < 1/2. Since r is weak-* exposed, first take Q in *"^jC([— i?, R]) 
exposing it in S^^, one can assume Q self adjoint. After multiplication by a scalar 
one can assume, since V = Ve^if(r)^ ^<Sr is ''^ compact set, that sup^^-gyc o-{Q) < 
t{Q) — 2. Let Qr, be a self-adjoint polynomial such that HQ — Q,i\\r < r//2. For 
any state a we have \a{Qn) — c((5)| < r//2, thus if cr ^ r: 

ct(Q^) < g{Q) + r//2 < r(g) + r//2 < r(g^) + 77 

and : 

sup cr(Q^) < r(g^) - 2 + 7/ < r(Q„) - 1. 

□ 

6. Extremal states 

We first prove a concentration lemma. 

Lemma 6.1. If t is an extremal state in S"^, n>\, then for any r\,t,K > 
there exists S,L > such that, for any probability measure ji on (TJ^)", whose 
harycenter is in Vs,l{'t)! have : 

fi{TR{T,e,K,N)) > 1-77. 

Proof. Let rj g]0, 1/4[. Then, by CoroUarv 15.41 we can find some self adjoint 
polynomial Qr, & C{Xi, . . . , X„) such that for every a G S^we have : 

r{Qr,) > <j[Qn) - 

and for all a ^ Vej^(r) one has : 

cr(Q^) < r(Q^) - 1. 

Let us now choose L = deg{Qn), and 6 small enough so that for all a G Vs.l{t) 
we have : 

|T(g,,)-CT(g„)| <r;/2. 
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If /i is a probability measure on {H§y^ whose barycenter is in Vs,l{t) then we 
have 



r(Q^)- 77/2 <r^(Q^) 



Therefore 



If 1 

—Tr{Q^)dfi+ / —Tr{Q^)diJ, 

rair.e.K.N) i(ff«)"\rH(T,e,if,Ar) 

<^i{^RiT,e,K,N))iT{Q,,)+7^/2) 

+ fi{{H^r \ TR{r, e, K, N)){t{Q,) - 1) 
< r{Q^) + - (1 - fi{rR{T, e, K, N))). 

li{rR{T,e,K,N)) > 1-77. 



□ 



Proposition 6.2. For any factor state r in S^, n> 1 : 

Likewise Xr{t) = XflC^), Xr{t) = XRi'r). 

Proof. Consider an extremal state r £ 5]^. and r],e,K > 0. We can choose 
(5, L as in Lemma l6. II so that we can estimate the entropy of fi using p.2p and the 
variations of x i— >■ .t log a; + (1 — x) log(l — x) : 

Leb ( fiJ^)") 

Ent(/.) < log Leb (r^lr, e, N)) + /.(r^lr, e, if, Nf) log ^^^^^ jV)) 
-?/log(?7)-(l-?7) log(l-r;) 
<(1 - 77) log Leb {Tr{t, e, K, N)) + 77 log Leb {{H^T) 
-77log(?7) - (1 -77) log(l-77) 



This inequality holds for all probability measures with barycenter in Vs^l{t), 
therefore the right hand side is a majorant of supg.gy^ ^(^j pn,l{o')- Now multiply 
both sides of this inequality by add ^ log and take liminf (or limsup or a 

limit to uj) then infimum over, successively, S, L,e, K, to get the result. □ 

7. Orbital free entropy and freeness in case of additivity of entropy 

7.1. Motivation. In this section, we extend the definition of orbital free en- 
tropy of |HMU| to not necessarily hyperfinite multivariables. Let us explain the 
main ideas before entering into technical details. Orbital entropy aims at mea- 
suring the lack of freeness in the same way that relative entropy of a measure fi 
with respect to the tensor product of its marginals (also called mutual informa- 
tion) does measure the lack of independence in the classical case. In the non- 
microstate context, Voiculescu first introduced in |V5| a notion of mutual infor- 
mation i* (W* {Xi, Xm),W* {Xm+i, Xjn+n)) measuring this lack of freeness 
using conjugation by a free unitary brownian motion and proved, using this tool, 
that additivity of non-microstate free entropy implies freeness. In the microstate 
context, |HMU| defined Xorb{Xi; Xn), which measures the lack of freeness of 
W*{Xi), W*{Xn) (and a variant where the W*{Xi) are replaced by hyperfinite 
algebras) relying on the fact that (at least at the level of measure spaces) the space 
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of herniitian matrices can be factored into eigenbasis and eigenvalues, allowing to 
build microstates in a product of unitary groups. This idea however breaks down 
when one tries to replace Xi by sets of variables generating non hyperfinite alge- 
bras, since in this case there does not exist a good description of the microstates. 
Our idea here is to overcome this lack of a microstates model by using entropies of 
measures instead of volumes of microstates. At this point, we have several possible 
candidates for a generalization. We will use one of them in this section, in order to 
reach our goal, the result that additivity of free entropy implies freeness. We will 
explore further possibilites, in order to lay the ground for future investigations, in 
the last section. Finally, note that we prove this result about additivity only for 
extremal states. It seems likely that for nonextremal states freeness should be re- 
placed by a kind of freeness with amalgamation with respect to some commutative 
central algebra, but we do not investigate this in the present paper. 

7.2. The orbital free entropy of Hiai, Miyamoto and Ueda. We con- 
sider finite sets of non-commutative random variables Xi = {Xn, ...,Xip.} for 
i = 1, . . . , n, and n = Pi, P ~ max^ Pi with joint non-commutative (tracial) 
distribution txi;...;x„ G 5". When each set X; generates a hyperfinite algebra, 
Hiai, Miyamoto and Ueda |HMU| defined orbital free entropy Xorh(Xi; Xn). 
Let us recall their definition. Let (Si(Af))i=i...„; iV oo be a sequence of matrix 
sets of size (S; = {^n, . . . ,^iPi}) which approximates (Xi)i=i...„ in mixed mo- 
ments as TV ^ oo. For U e U{N) we denote UEi{N)U = {U^nU*, U^.p^U*}. 
Let 

Fo^t (Xi , . . . , Xn : Si (TV) , . . .S„ (TV) , iV, if , e) 

be the set of (J7i, . . . , Un) e J7(TV)" such that the conjugated sets {U.iEi{N)U*)i=i,,,n 
approximate the mixed moments of (Xi)i=i...„ up to an error of e and for degrees 
less than K or, in other words, such that T(7jHi(7v);7*....,(7„H„(Ar);7* € 14,/^ (TXl;...;X„)• 
Let be the Haar measure on J7(TV)" (which, in the sequel, we will always as- 
sume normalized to be a probability) , and 

(7.1) 7JV,H(JV),e,K = H'A(Fo,b(Xi, X„ : Si(TV), S„(TV), TV, K, e)) 
then the orbital free entropy is defined as : 

Xor6(Xi,...,Xn) = lim limSUp-^log7jv,H(Ar),e,K- 

It is proved in |HMU| . Lemma 4.2, that this quantity does not depend on the 
chosen sequence S(TV). This relies on Jung's Lemma [J], (see also Lemma 1.2 in 
|HMU| ) which we recall here for future reference. 

Lemma 7.1. Let r = txi,...,x„, where the variables Xi, . . . , X„i generate a 
hyperfinite algebra. Denote by \\.\\p the p-norm associated with r. For every e > 
there exists L,5 such that, for every S = (^i,...,^m) and S' = (Cij---;^m) 
(TJat)", satisfying th,th' G Vs^LiT), there exists some unitary U € f/(TV) such that 

\\Ui,U* -CiWp < fori^l,...,n 

Furthermore, Hiai, Miyamoto and Ueda proved that free orbital entropy de- 
pends only on the W*-algebras Wi = Xi" generated by each set, i.e. 

XorbO^i] X„) = Xor&(Yi; Yn), 
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for any other choice of finite sets Yi; Yn such that Wi = Yi" (note that one does 
not assume that Xi,Yi contain the same number of elements). Also they proved 
the formula relating orbital free entropy to Voiculescu's free entropy: 

(7.2) x(Xi U ... U X„) = Xort(Xi; X„) + xi^i) + - + x(Xn), 

and proved that, for a set with finite free entropy, additivity of free entropy, i.e. 

(7.3) x(Xi U ... U X„) = x(Xi) + ... + x(X„), 

which is equivalent to Xorb (Xi ; . . . ; Xn) = by (j7.2[) , holds if and only if Xi , . . . , Xn 
are free. 

7.3. Orbital free entropy for arbitrary multivariables. In the following, 
we give a definition of Xorbi^i', •••;Xn) for arbitrary finite sets Xi; ...;Xn, which 
coincides with the previous definition when the sets of multivariables are hyperfinite 
and Txi:...;Xn ^ factor state. 

Let n G P{H^Y' be a (Borel) probability measure on {H§y' ^ I\i{H§)^\, 
considered as the joint distribution of sets of random matrices Mi; Mn, with 
Mi = {Mil, . . . , Mip.}. We denote hy Ufi the probability measure on {H§)'^, 
obtained by conjugating the sets Mi by independent Haar unitaries from U (N) , 
i.e. UiJ. is the joint distribution of the sets UiMiU* = {UiMnU* , . . . , UiMiP^U*], 
where Ui, . . . ,U„ are independent unitary matrices, all distributed according to 
(normalized) Haar measure on U (N) . Equivalently, if 

: U{Nr X {Hnf ^ {HrT 
is the map given by conjugation: 

(CA, Xi)i=i^...^„ 1—^ (tAXiC/*)i=i_..._„ 
then J7/i is given by the pushforward measure : 

Definition 7.2. Let Xi; Xn be finite sets of noncommutative random vari- 
ables as above, their orbital entropy is defined as : 

/ 



Xor6(Xi; X„) = sup lim limsup 



sup Ent(^|C//i) 

\ ^|j£^'€,K(^Xi,...,Xn) 



Similarly we define the liminf and ultrafilter variants x^^^ and Xorh- 

Note that, in this definition, limits in are actually infima. 
Recall from |Vll Def 3.1] that a state is said to have finite- dimensional approx- 
imants if for every K, e there exists A^o such that for N > Nq, rfl(r, e, K, N) ^ 0. 

Theorem 7.3. The orbital free entropy satisfies the following properties. 

(1) (Negativity) 

Xorh(Xi; ...;Xn) < 0. 

(2) (Vanishing for one multivariable) 

Xor&(X) = 0, 

for any single multivariable X — {Xi, . . . ,Xm} having finite- dimensional approxi- 
mants. 
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(3) (Monotonicity) 

Xorfc(Xi; Xn) < Xor6(Yi; Y„), 
if Yi C Xj for 1 < i < n. 

(4) (Subadditivity) 

Xorh(Xi; Xm; Xm+i; Xn) < Xorb(Xi, Xm) + Xorb(Xm+i; Xn). 

(5) (Connection with free entropy) 

X(Xi U ... U Xn) < Xo.h(Xi, Xn) + x(Xl) + . . . + x(Xn). 

(6) (Agreement with previous definition ) 

Assume Xi are hyperfinite multivariables and let Xorf)(Xi; Xn) denote the 
orbital free entropy of [HMU] , then 

Xorfc(Xi; Xn) < Xor&(Xi; Xn). 

Moreover, i/TXi,....x„ *s extremal then 

XoT-b(Xi; Xn) = Xorb(Xi; Xn). 

(7) (Alternative microstates formula in the extremal case) 
//7Xi,...,Xn is extremal then 

Xor6(Xi; ...;Xn) = sup lim limsup sup ( -r|^ log7Ar.H.£.if ) . 

R K^oc,e-,0 jv^^ H,THeV;,K(Txi,.^.,x„) / 

(8) (Dependence on algebras) 

//Xi,...,Xn, Yi,...,Yn are multi-variables such that Yi C VK*(Xi) for 
1 < i < n, then 

Xorfc(Xi, . . . , 

-^n) S Xorb (Yi,...,Yn). 

In particular, Xorb(Xi, . . . , Xn) depends only upon W*{'Ki), ... ,W*(X.n)- 

(9) (Orbital Talagrand's inequality and Characterization of Freeness) 

For T = Txi,...,x„ extremal, let Tfree = TKi * • • • * tx„ i/ie /ree product of its 
marginals, then : 

dw{T , Tfree ) < 4i?-y/-Pxorb(Xi; ...;Xn), 

where dw is the 2-Wasserstein distance of |BV| . a consequence, if t is extremal 
and has finite- dimensional approximants, then Xorb(Xi; ...;Xn) ^ if and only if 

Corollary 7.4. //x"(Xi U ... U Xn) > -oo, then 

x"(Xi U ... U Xn) = x"(Xi) + ... + x"(Xn) 
if and only i/Xi, Xn are free. The only if part also holds for the limsup variant 
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Proof of corollary. Assume Xi U ... U X„ has finite entropy , and 
x(Xi,...,x„) = x(Xi) + ... + x(X„). 

By finiteness of Voiculescu's entropy we know that Txiu...uXn is an extremal 
state and, by proposition 16.21 xO^i^ ^n) = xl^i: ^n)- 

Assume also for contradiction XorbO^i, ■ ■ ■ , X„) < 0. From (5) of Theorem l7.3l 
we get : 

x(Xi) + ... + x(X„) < x(Xi) + ... + x(X„). 

By the general inequality in proposition 14.31 there exists an i with x(Xi) < x(Xi). 
By the end of remark 14.51 the set Xj contains at least two variables, so that by 
proposition 16.21 again, cannot be extremal, which implies x(Xi) = — oo by 
Voiculescu's result |V3| . a contradiction with x(Xi U ... U Xn) > — oo. 

We thus deduce, using (1) of Theorem 17.31 XorbO^i, ■ ■ ■ , Xn) = 0. 

Then Xi,...,Xn are free by point (9) of the same theorem. The ultrafilter 
variant is similar. The converse statement is due to Voiculescu | Vl| . □ 



Proof of Theorem 17.31 In the following we say that ^ is an approximating 
measure for t if belongs to Ve,/f (r) for some e,K > 0. 

(1) Negativity follows from the negativity of relative entropy. 

(2) For a single multivariable, if fi is an approximating measure, then v = 
Ufi also approximates with the same precision, and obviously Uv = u, therefore 
Ent(i/|C/i^) = 0. 

(3) If Yi C Xi for 1 < i < n and /i is an approximating measure for the X^, 
then its image by the projection map q on the marginal distribution of the Yj is 
an approximating measure for the Y^, furthermore qlJ ^ = Uq^, therefore by (|3.ip 
we have 

Ent(^|C//i) < Y.\\t{q^l\qU = Ent(g/x|C/q/.t), 
and taking limits gives the required inequality. 

(4) If is an approximating measure for Xi; ...;X„ let and denote the 
marginal distributions of Xi ; . . . ; Xm and Xm+i ; • ■ • ; Xn , then U pLi and U fj,2 are the 
marginal distributions under Ufi, therefore, by subadditiviy of relative entropy: 

Ent(^|C//i) < Ent(//i|;7Afi) +Ent(/i2|^7^2)• 
The inequality follows by taking limits. 

(5) Let /X be an approximating measure on {H^)" = (H^)^^ x . . . x (H^)^", 
with finite entropy, and consider the action of U{N)'^ by conjugation on {H§)", 
then Ufj, is the average of {Ui, . . . , ?7„) • ^ with respect to Haar measure on U (A^)". 
Let / be the density of fj, with respect to Lebesgue measure on (i/^)", then fjj, 
the density of Ufj. is the average of f{{Ui, . . . , Un)-) with respect to Haar measure. 
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It follows that : 

Ent(/i) = - / f log fdM 

= - I -f^og^ fu dM^ I f log fudM 

= Ent(/i|;7/i) - / flog fudM 

= Ent{n\U^)- [ fulogfudM by [/(A^)" invariance of 

= Ent{fj,\Un) +'Ent{Un). 

Now we can use the subbadditivity of Ent([//i) with respect to the projections on 
the spaces (H^)^', which gives 

Ent{Ufi) < Ent(piJ7^) + . . . + Ent{p„Ufi) 

Letting N-^oo,K-^oo,e^O gives the required inequality. 

(6) Let S(-/V) be an approximating sequence, as in the definition of (hyperfinite) 
orbital free entropy. Let i's{n) be the probability measure obtained by restricting 

to ror6(Xi, X„ : Ei{N), ...En{N),N,K,e) and normalizing (if the orbital 
entropy is finite and N is sufficiently large, this measure is well defined), then (recall 

(EH)) 

log7Af,H(Af),£,/f = Ent(l/H(^)|H^). 

Let ^'e:(jv) ■ U{Ny^ {Hb}" the map given by conjugation : 

(.U^)^=1 „ ^ (C/.S,(iV)[/*)^=l,...,n 

we have U'9e{N)*{'^b.{n}) = '^e{N)*{'Hn) therefore, by p.ip 

^Ent(zyH(Ar)|H^) < ^Ent(«'H(W)*(;^H{W))|C/«'H(iV)*(;^H(W))). 

Since '^E{N)*i'^B.{N)) is an approximating measure for Xi,...,X„, the right hand 
side, after taking limits in N,e,K, is bounded by Xorbi^i, •••jX„). The inequality 

Xorb < Xorb follows. 

Let us now assume that t := txi,...,x„ is extremal. Fix jy, e > and an 
integer > 0. Using Jung's Lemma, and following the proof of Lemma 4.2 in 
|HMU| ■ we can take i5< e/2, L> K such that, for all families of sets (0i)i=i,...,,i of 
N X N hermitian matrices such that for all i we have ^et) G Vs,L{PiT) (a fortiori if 
■''(ei)i=i n S Vs^l{t)) we have, for N large enough : 

Note also the elementary equality for any Ui, ...,Un unitaries coming from invariance 
of the Haar measure : 

(7.5) 

Then using Lemma lOI if we take 5' > Q sufficiently small and L' sufficiently large, 
for any measure ji on {H^)" such that G Vs'^l'{t), we get : 

/x(rfl(T,5,L,iV))>l-r,. 
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Therefore, by (3.3), 

(7.6) Ent(Ai|C//i) <{l-v) log [U^,{TR{T, 6, L, N))] - fin), 

with f{r]) = 77 log 77 + (1 - ?;) log(l - rj). 

Let UTr{t,S,L,N) = {9 | 3(C/i, .., C/„) $jv((7i, C/„, 9) G Tr{t,5, L, N)}. 
The measure C//x is the image of (8> /i by the conjugation map <i>jv, and the set 
^N^O^niTj ^7 L, N)) is the union over matrix sets : 

^e£uraiT,5,L,N)^orb0^i, X„ ; 9i, ...Qn,N,L,S)x{Q}. 

It follows that : 

UfiiTR{T,S,L,N))^ I lN,e.5,LdKQ) 

JUTR(r.S,L,N) 

^^■^^ < / lN,B.e/2,Kd^l{Q) by 5 < e/2, L>K 

JuTr{t,S,L,N) 

< lN,s{N)^e^K by (m and dLS]). 
Then combining (|7.6p . ()7.7p and taking limits yields the inequality : 

Xorh < (1 - V)Xorb- 

Since 77 is arbitrary, we are done. 

(7) The proof is a variant of the one in (6). First take some familiy S of her- 
mitian matricies with e V'e^/f (txi,...,x„)- Replacing S(iV) by S in the arguments 
of the first part of (6) we deduce : 

log7JV,H,.,K = Ent(i^HlH^) < Ent(*H*(i^H)|t/*H»(i^H)). 

Since r^^^j^^) g V'e.x(Txi,...,Xn) we obtain the following inequality : 

^ogjN.s.e.K < sup Ent(/i|C//i). 

^fi'^^e,if(^Xi,...,Xn) 

This implies the lower bound in the statement. 

Assume now that r = rxi Xn extremal. Fix 77, e, K choose S, L as in lemma 

16.11 For any fj, E P{H^)^ with G Vs^l{t) we have : 

Ent(/.|t//x) < (1 -77)log[[/Ai(ri?,(T,e,A',iV))] -/(7,). 

With the same computation as in the proof of (|7.7p we get the inequality : 

U^l{TIl{T,€,K,N)) < sup lN,~,e,K- 
H,rHGVe_A'(rxi Xn ) 

The second inequality of the statement follows. 

(8) Let Xi = {X,i,...,X,pJ and Y; = ■ • ■ , FzqJ, with rfi = J2^Q^■ 
By Kaplansky density theorem, for each i, one can find a set of non-commutative 
polynomials Py (Xi), j = 1, . . . ,Qi as close as we want in distribution to the set 
Yi. For such a family, we write : 

Pi(Xi) = (Pa(Xi),...,P,Q,(Xi)), 

P(Xi,...,X„) = (Pi(Xi),...,P„(X„)). 

Let e,K>0. One can find polynomials (Xi), j = 1, ■ . ■ , Qi, a real 5 > 
sufficiently small and an integer L sufficiently large such that for all ^ probability 
measure on {H§)"- in V5,L('rxi,...,x„) we have P*/i G Ve,K(rYi,...,Y„) 
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Since $„((C/i, [/„), (Pi(Xi), P„(X„)) = {Pi{UiXiU^), ...P„([/„X„C/*)), 
it is clear that UP^fi = P*[/^. By dSH]) we have Ent(P*//|;7P*/i) > Ent(//|[//i), 
therefore 

—J sup Ent(i/|C/j/) > — sup Ent(^|l7^). 

-'^ i^.r^eVj^A-CTYi Y„) A',veVa_t(rxi,...,Xn) 

Now take a hmsup then infiinuni over, successively, S, L, e, K, to get the result. 

(9) First, choose a subsequence N„i and /x,„ probability measures on {H§^)^ 
such that (t^^ ) converges weakly to t and : 

1 



Xor(,(Xi; ...;X„) = Jim ( — 2-Ent(//„i|C/^,„) 



Without loss of generality, we assume that this orbital entropy is finite. We follow 
arguments close to the proof of Lemma 3.4 in |HMU| . Remark that in the definition 
of Un we can replace the unitary group U{N) by SU{N), since U{N) acts by 
conjugation. Let /^(M) be the density of /im with respect to U^m (which exists 
if m is sufficiently large). Then for almost all values of M, the function 

gmiUi, ...[/„, M) = /™([/iMi(7r, . . . , UnMnU*) 

is a probability density in the variables Ui, . . .Un, with respect to the Haar mea- 
sure ST-C^^ on SU{N„i)^. For M let ttm, be a probabihty measure on SU{Nm)^ x 
SU{Nm)", which is an optimal coupling between g,n{Ui, . . .Un, M.)STC^^ and STL'^^^ 
for the geodesic distance on SU{Njn)". This means that the marginals of the 
measure ttm on the two components of SU{Nm)" x 5f7(A'^,„)" are the measures 
gm{Ui, ■ . - Un, M.)S7i^^ and STC^^ , and the squared Wasserstein distance between 
the measures g^iUi, . . .Un, 'M)S'H^^^ and SH^^ is 

/ ['^gcod 

((c/i, Un), (Vi, y„))]'d^M(c/, V) 

JSUiN^)"xSU{N^)" 

Such a measure can be constructed measurably with respect to M (see e.g. corollary 
5.22 in |Vi| ) . We thus deduce an estimate for the non-commutative 2- Wasserstein 
distance : 



Pi 



dw{Tfi^,TlJfi^Y 

< J d[/Mrn(M) J d7rM(U,V)^X] ^IlL/.MyC/; - VM^JV*\\ls 

1=1 j=l ™ 

< / d[/Ai,„(M) / d7rM(U,V)4i?2p^^||U, -V,;|||,s 

< JdUfirniM) y"d^M(U,V)4i?2p_^ [dg^ociiiUl, ...,Un),{Vi, ...,Vn))]\ 

where we used the fact that the Hilbert-Schmidt distance can be majorized by 
the geodesic distance. Now using the Talagrand inequality of |OV| on SU{Nm)", 
as in Proposition 3.5 of |HMU| we get : 

f dU^i,n{M)-^Ent{g{Ul, Un,M.)S7ef,JU)\S'HUU)) 
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Now we can use the fact that Ufirn is invariant by the action of U{N)^ and 
interchange the order of integration to get 

Ent(g(t/i, . . . , Un, M)SHl^SU)\S'HlJU))dU^i,n(M) 

^ J J fmiUiMiU*, !7„M„f/*) log/™(C/iMi[/*, . . . , UnMnU:)d'HlJV)dU fimiM) 

= Ent(/im I 
thus 

(iiv(T-^„,Tc/M™) < Ent(/i„|C/^„,). 

By our choice of /im, the noncomniutative distribution of the random matrix sets 
M under /x^ converges weakly to t as — > oo. Let us check that similarly, under 
Ufim this noncommutative distribution converges weakly to Tfree- This is a conse- 
quence of Remark 3.2 in [C]. Indeed, there it is proved that M is asymptotically 
free from {Ui},..., {Un} (independant Haar unitaries) provided the distribution of 
M concentrates around its mean. But this concentration is provided by Lemma 
16.11 We leave the easy but tedious details to the reader. 

As a consequence of Talagrand's inequality, the only if part of the characteri- 
zation of freeness is obvious. Now assume t = Tfree and take /i^ as above so that 
now T(7p^ tends weakly to r = Tfree- Thus for m large enough so that tu^^ e,K 
approximates r we have 

0= (-^Ent([//x,„|C//x„)) < -i^ sup Ent{fi\Uti). 

^fi£^'E,K(^Xi Xn) 

As a consequence taking a limit in m and then in e, K since they are arbitrary 
in the argument above, we get Xorbi^i, • • • , Xn) = 0. 

□ 

8. Preliminaries about entropy, marginals and unitary invariant 

versions of a measure 

Before giving several other generalizations of orbital entropy, we start with 
some preliminary results. 

Let ^ G P{{H^)"), considered as the probability distribution of a family of 
random matrices (Ai, An), where each Ai consists in a bunch of variables like 
Xi. Again C//i is then the law of ([/lAit/j , [/„AnC/*) where Ui are independent 
variables distributed with respect to the Haar measure Hjv of the unitary group 
U{N). More generally, we consider partial conjugations in the following way : if 
TT : [1, n] — >■ [1, ^] is a surjective map (equivalently, we can consider the partition 
n = {7r^^(i)}i=i,....^ of [l,n] which it defines) we denote ijl{= U^h) the law of 
(C/^(i)Ai[/*(.j^j, [/jrfnjAnC/*^^^) whcrc the Ui,i = !...,£ are independent Haar 
random unitary matrices. We will write for the global unitary invariant version, 
corresponding to H = {{1, n}}. It is clear that for any absolutely continuous 
measure fj, the measure fi is absolutely continuous. 

Lemma 8.1. (i) Let e P{{H^)") with U'^v = v, then 

Ent{yi\v) = Ent{ii\U'' [i) + Ent{U'' p\v). 
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(ii) Let fi e P{{Hg)^) and = 0, m,, jy^ e P{{H^)^'). We denote qifi and 
q2fJ- the marginals for the bunch of variables corresponding, respectively, 
to (Ai,...,Am) (Am+i, An), then 

Ent{iJL\v) = Ent(ii\qiii ® (72 A') + Ent(qiiJL ® q2p\v). 

(iii) With the notations of (ii) and V = for 11 = {{1, .., m}, {m + 1, .., n}} 
we have : 

Ent{Vp\Uii) < Ent{qiU^ p\Uqiy) + Ent{q2U^ p.\Uq2ti)- 

Proof, (i) This is a generalization to relative entropy of an equality in the 
proof of Theorem 17.31 (5) above. Without loss of generality we assume n <^v since 
if we don't have both p, <^ Lf^fi and p <^ v, the right hand side is —00 and 
the equahty is true if we don't have fi v, so that in any case we can assume 
11 V. Consider p ~ Since v is unitarily invariant, we have p <C V^v = v. 
Moreover. 

p;7(Ai,..., A„) := ^^^-^(Ai, An) 

av 

= I dHl,(C/i,...,t/,)p(t/,(i)AiC/;(i),...,C/,(„)A„t/:(„)). 

Using (|3.ip we have 'Ent{p\i') < 'Ent{U^ p\i/) and we can thus compute : 

Fint{p\i') = — / p\n{p)di' = — / p\n{pir)di' — / joln( — )dz^ 
J J J pu 

^ ^ j Pu ln(/Oc/)rfi' + Eut{p\Up) 

= Ent{Up\iy) + Ent{p\Up), 

where, in the third line, we used unitary invariance to replace p by pij. The reverse 
implication starting from finiteness of the left hand side is also clear. 

(ii) The proof is similar to (i). In order to solve finiteness issues, one can again 
use p.ip to get Ent(/i|i/) < F,nt (qiplqii/). 

(iii) The inequality comes from subadditivity of entropy. Indeed consider, 
without loss of generality, pv the density of Vp with respect to Up. Using unitary 
invariance of Up we get : 

Ent{Vp\Up) = - J pvMpv)dUp 

= - J dUp{A) J R{Ui, Un, A) ln(i?(C/i, f/„, A))dni{Uu C/„), 

where, for a.e. A = (Ai, A„), the quantity 

R{Ui, Un, A) ^ pviUiA^U*, C/„A„[/*) 

is a probability density on U (A^)". Let Ri, R2 be the densities of marginals, namely, 
with obvious notations, 

i?i(U2,A) = J d7^5V'(Ui)i?(Ui,U2,A), 
i?2(Ui,A) = j dHl-^{\J^)R{\5^,\J2,A). 
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we have 



i?2(Ui, A) = i?2(I, f/iAif/*, . . . , U^A^U*^,A, 



m+l ; • ■ • ; A-n) - 



Moreover 



R2{l,A)dU^l{A)^dV^l{A) 



is a probability measure with marginal qiV ^ = qiU^^. Using the subadditivity of 
ordinary entropy relative to a product measure, we get : 



9.1. Overview. The main drawback of our definition of orbital free entropy 
is that we are unable to prove equality in part (5) of Theorem 17.31 In order to 
overcome this problem, as mentionned at the beginning of section 7, several other 
generalizations of orbital entropy may be considered. We will describe below two 
variants which we call maximal mutual entropy and I-mutual entropy. The last one 
satisfies the required additivity property however we lose the fact that it depends 
only on the subalgebras generated by the subset of variables. Let us describe briefiy 
the content of this section. First, we can consider, as for Voiculescu's entropy, a 
variant of free entropy in the presence of another set of variables, which plays a 
dummy role in the definition. This will be considered in section 19.21 Instead of 
using the relative entropy of fi, an approximating measure, with respect to its 
unitary invariant mean Ufi, we can consider the relative entropy with respect to 
the product of the marginal distributions of Ufi with respect to the subsets. This 
yields a quantity which we call maximal mutual entropy, and which we consider 
in section 19.31 Again this quantity depends only on the W* algebras generated by 
the subsets, and is subadditive. Another alternative is to use Ciszar's I-projection 
first and then to take the relative entropy of this specific measure with respect to 
the tensor product of its marginals (which are automatically unitary invariant in 
this case) . This gives what we call I-mutual entropy, studied in section 19.41 This 
quantity satisfies a strong additivity property (property below), which generalizes 
the additivity of the orbital entropy of |HMU| . Unfortunately, we are not able 
to prove that it depends only on the W* algebras generated by the subsets. All 
these entropies coincide with orbital entropy defined in |HMU| in the context they 
define it. It is plausible that they always coincide, although we do not have a proof 
of this fact at this stage. 

9.2. Orbital entropy in the presence of other variables. As in section 6, 
we consider finite sets of non-commutative random variables Xi = {Xn, Ajp. } 
for i = 1, . . . ,n, and n = P,;, while Y = {Yi, . . . ,Yt} is likewise a multivariable 
containing t variables. Their joint non-commutative (tracial) distribution is t = 
7'Xi;...;X„;Y G S^^^* . Wc wiU use the notation : 




< Ent(qif/'^/^|t/gi/i) +Ent{q2U^ ^J.\Uq2^J,). 



□ 
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Also we denote pfi the marginal distribution of /.t on the X variables. 

Definition 9.1. The free orbital entropy o/Xi,...,Xn in the presence 

ofY is, i/r = rxi,...,x„,Y : 

Xor&(Xi; ...;Xn : Y) = sup lim limsup | -^^ sup Ent{pfi\Upfi)] . 

The orbital free entropy in the presence of other variables satisfies properties 
similar to the ones of Theorem l7.3l the proofs being easy variations on the proofs for 
the orbital free entropy. We state here only an improved version of the additivity 
property. 

Theorem 9.2. 

XorbO^l', ^m', Xin+i; : Y) < XorbP^l U ... U X^; X^+i U ... U X^ : Y) + 

XorbO^i; •••;Xm : Xm+1 u ... u X„ u Y) + XorbO^m+i; •■•;X„ : Xi U ... U Xm U Y). 

Proof. Write for /i in AN^^^xiT) Vp^ as in lemma lHTK iii) the unitary invariant 
variant for blocks. Note that pU'~^fi = U^pfj, and : 

Ent{pfi\Upfi) ^ Ent{pfi\U'^pfi) + Ent{U^pn\Upfi) < Ent{U'^pfi\Upfi), 

(from lemma ISTTI (i) ) so that, since U^n G Ai\[,^,k{t); we may assume /i — U'^ ji 
when we bound orbital entropy. Applying lemma 18.11 (i) and (iii) we get the con- 
cluding estimate 

Ent(p^|[/p^) = ¥l\lt{p^J^\Vp^J^) + Ent(T^p/x|;7p/x) 

< Ent(p/^|Vp^) + Ent(gi/^|C/gi^) +'&i\t{q2^i\Uq2li). 

□ 

9.3. Maximal mutual entropy. We use the same notations as in the preced- 
ing section, and denote pi, . . . ,p„ the projections on the sets of variables Xi; Xn. 

Definition 9.3. The /ree maximal mutual entropy o/Xi,...,Xn in the 
presence o/ Y is , if r = txi x„.y : 

XMrnttt(Xi; Xn : Y) = 

sup lim lim sup I sup Yjnt {p ^\piU p ® ... ® pnUpijA 

If Y is empty we just write XMmut(Xi; Xn). 

Note that the limits in e, K are actually infima. We also define a notion of 
relative entropy to state the best subadditivity result. We compare it in the next 
subsection, but note already that it coincides with the definition of section 4 when 
Y = 0. 

Definition 9.4. We define, for r = txi,...,x„,Y! a random microstate free 
entropy in the presence of Y as : 

x(Xi;...;Xn:Y) = 

sup lim limsup(-— ^ sup Ent(p/i) + — log j 
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Theorem 9.5. The free maximal mutual entropy satisfies the following prop- 
erties : 

(1) (Vanishing for one variable) 

XMmutO^l) = 0, 

for any single multivariable having finite- dimensional approximants. 

(2) (Improved Subadditivity) 

XMmutP^li Xm+i; Xn : Y) < XA/mut(Xi U ... U Xmi X^+l U ... U Xn : Y) + 

XMm«t(Xi; Xm : X^+i U ... U X„ U Y) + XMmut(Xm+i; Xn : Xi U ... U Xm U Y). 

(3) (Improved subadditivity of entropy) 

x(Xi, X2: Y) < XA/m«t(Xi; X2: Y) + x(Xi : X2UY) + x(X2 : XiUY). 

(4) (Agreement with previous definition) If are hyperfinite multivariables 
then 

Xorb(Xi; Xn) < XMmut(Xi; Xn) 

(where free orbital entropy is in the sense of |HMtJ] }. If moreover T-x.i,...,-x.n 
is extremal then 

XA/mMt(Xi; Xn) = XorbP^l', Xn). 

(5) (Dependence on algebras) If Xi, . . . , Xn, Yi, . . . , Yn are multi-variables 
such that Yi C W* {Xj) for I < i < n, then 

(Yi,...,Yn). 

In particular, XMmut (Xi, . . . , Xn) depends only upon VF*(Xi), . . . , VK*(Xn). 
Proof. The proofs of (1),(5) are similar to the corresponding properties of 

Xorb- 

(2) Let p be the projection on the X variables, pi the projection Xi, and gi, 52 
the projections on Xi, . . . , Xm and Xm+i, . . . , Xn, respectively. Let fi £ An_c_k{t), 
we may assume, as in the proof of Theorem l9.2l jj, = C/'^/i, so that we have piUp^ = 
PiU and QiVfi = qiH- Applying lemma l8Tl (ii) we get : 

Ent(p^| ^PiUpfi) = Ent(p/^|(7il/p/i ® q2Vpn) + Ent(gi^ (E) q2t^ \ ^PiUp^i) 

i i 

And we have : 

Ent((3'i/x® (72A*I (^Pi'^PA*) = Ent((7i/i| piUpy) +'&T\i{q2pL\ PiUpy). 

i i—l,...,m i— m+l,...,n 

Taking suprema and limits yields the inequality. 

(3) With a similar notation as in the previous point, we take — U'^ y in 
AN,e,K{T), then : 

Ent(jpy\Leb) ~ Ent(p/i|(7iF/i ® q2V 11) + Ent((7i/i ® q2i-i\Leb) 

and again we may take suprema and limits to get the required conclusion. 

(4) This follows from Theorem 17.31 f6). as well as Theorem 19.91 (4) and Propo- 
sition inUHl to be proved below. 

□ 
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9.4. I-mutual entropy. In order to extend again in this subsection |HMU| 
for (not necessarily hyperfinite) imiltivariables, we consider niultivariables Xi = 
(Xii, Xip.) where each Xy is itself a family of hyperfinite niultivariables, i.e. 
Xij = {Xiji, ...,XijQ^.} and A = Y^^LiQij: " = Yl'i=iPi- For the definition of 
free entropy in presence we consider also analogously Y = (Yi, Yp) containing 
t variables. For technical reasons (in order to get values agreeing with those of 
|HMU| in the hyperfinite case) we will let the approximations depend on doubled 
parameters e = (ei, £2), K = {Ki, ^^2). 

We first consider cr^j = (7Ar^e2.x2 (TXy ) the normalized restriction of Lebesgue 
measure to the set ^2,^2 (Pij''') of £21^2 approximations of p^r = rxy where pij 
gives the marginals on the ij -th bunch of hyperfinite variables. We denote by 
CN,e,K{T) Csiszar's I-projection of SN.e2,K2{''') '■= ®i j ^ij • 

AN,e,K{T) = {/i e P((if^)"+*) I G V^.^K^ir) p^jT,, G V,2,KAP^lr)}. 

Thus, we allow us to approximate better the hyperfinite marginals. This will be 
used to define an I-mutual entropy with good additivity properties, which was 
a motivation for Voiculescu's non-microstates mutual information and for Hiai- 
Miyamoto-Ueda's microstate variant. However the other variants seem to be better 
behaved in every other respects. We will use not only a free ultrafilter lu on the 
integers but also a point 6 in the boundary of the Stone-Cech compactification of 
(0, 1]. If Ajv,£,i4'(T) does not contain elements of finite entropy, any entropy involving 
CN,e,K (thus undefined) is by convention —00. Likewise, a sup over an empty set 

is — CXD. 

Definition 9.6. Let r = rxi x„.y, we define I-mutual entropy as 

Ximut (Xi ; . . . ; Xn : Y) = sup lim sup lim sup lim sup lim sup lim sup 

R>TZ(t) ei-i-O ifi-i-oo e2->0 K^^oo Af-s-oo 
(^-^^nt{pCN,cM{T)\PlUpCN,c,K{T) ® ■■.®PnUpCN,e.,K{T)^ , 

where Pi is the projection on submultivariables Xi and p on Xi, X,,. We write 
X/mut(Xi; ...;Xn) when Y = 0. Likewise we define Xjj^^j(Xi; ...;Xn : Y) a liminf 
variant (with respect to e, K) of I-mutual entropy and an ultrafilter variant 
X7m„t(Xi; X„ : Y) (with YuTVi/j^^g lim^j^e lim^i^t^ lim^^^e limx^-f^ limAr^^). 

We will also need a notion of free I-entropy in the presence of other variables to 
get additivity properties with I-mutual entropy. Instead of maximizing the entropy 
of the projection of measures also approximating Y, which would be more natural 
in the spirit of Voiculescu's definition and correspond to the definition taken in the 
previous subsection, we take Csiszar's projection including approximation of Y, we 
project and take entropy. 

Definition 9.7. We define free I-entropy in the presence of Y as : 

X/(Xi; Xn : Y) = sup lim sup lim sup lim sup 

(^^Ent(pCjv,e,K(TX„...,x„,Y)) + ^logiV^ , 

and likewise X/'''(Xi; ...;X„ : Y), Xj(Xi; ...;X„ : Y). 

We have inequalities, as in sections 4 and 6, given in the following lemma. 
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Lemma 9.8. We have : 

X/(Xi,...,X„:Y)<x(Xi,...,X„:Y), 

x(Xi;...;X„: Y) <x(Xi,...,X„: Y), 

x(Xi;...;X„) < x/(Xi,...,X„), 

and corresponding ultrafilter, liminf variants. 
If TXi;...;Xn.Y extremal we also have : 

x(Xi,...,X„:Y)=x(Xi,...,X„:Y). 

Especially, if T-x.i-...-x.n is extremal we have : 

x(Xi; ...;X„) = x/(Xi; ...;X„) = x(Xi; ...;X„). 

Proof. Let t = TXi;...;Xn:Y Since Cn.c.k G ^Ar.(ei,ei),(_fs'i,_fs'i)(T) by definition 
we obtain x/(Xi; X„ : Y) < x(Xi, Xn : Y). 

The inequalities between x £md x £^re similar to those in sections 4 and 6. Let 
us merely outline the proofs for the reader's convenience. First, recall Voiculescu's 
definition from |V3| : 

x(Xi;...;X„ : Y) = sup lim limsup ( logbLflXr, e, iV)) + J logiV 

where pA e (ijj^)" is now the projection of the set A 6 

Fix e, i^T > 0. For M G pTfj^r, e, K, N), we consider the fiber : 

Trm = ({M} X {H^ Y) n Tr{t, e, K, N). 

We define a probability measure fi with support in Tii{T, e, K., N) (so that £ 
Ve.K{T)), on a measurable set A G by : 

1 f (5m X Leb(^«)t)(Anrij,M) 

u(A)^ } 7 TT / dLeb,„ivv-i(M) — ^ — . 

'^^ ' Leh{prR{T,e,K,N)) Jpr,Xr.e,K.N) (^m x Leb(^iV)0(ri?„M) 

By definition, we get pp,{B) = Lch{prJr,e,K,N)) ^^HB npTR^r, e, K, N))), so that : 

log(prfl(r, e, K,N))^ Ent{p^l) < sup Ent(p/^). 

We conclude x(Xi; X„ : Y) < x(Xi, X„ : Y). 

Conversely, assume r extremal. Fix rj, e, K > and choose (5, L as in Lemma 
l6.1l so that, if /i e Am.s,l{t), piiT fi{T,e,K,N)) >l — i]. Note that we have : 

Pii{pTn{T, e, N)) = ii(j>VR{T, e, N) x {H^ )*) > ^(rfl(T, e, A', iV)) > 1 - 77- 

Thus, as in proposition 16.21 we get x(Xi, Xn : Y) < (1 — 77)x(Xi, Xn : Y). 

Consider now the case without Y, the only remaining inequality is x(Xi; Xn) < 
X7(Xi, ...,Xn). First, note that : 

Indeed by its definition as Lprojection of the measure Sm,<l2,K2; we know that 
Cn,£,k has a density with respect to Sn,£2,K2i ^'Hd since Sn,il2,K2 is Lebesgue mea- 
sure normalized on some set, the density with respect to Lebesgue measure does 
not change except for a constant and the equality above is thus easy. 
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We can also consider RN,e2..K2 the normalized Lebesgue measure on Tii{T, 62, K2, N) 
so that : 

log(Lcb(r_R(r, £2, A'2,iV))) = EntlRN.c2.K2) Ent{RN,e2,K2\SN,e2.K2) + Ent{SN,C2.K2)i 

the last equality coming from inclusion of the support of R in the support of S, 
both being normalized Lebesgue measure on subsets. Finally, by definition of I- 
projection, we get the inequality : 

Ent{CN,e,K\SN,e2,K2) > -B??.t (i?jv,c2 ,^2 I '5'w,e2 2 ) • 

As a consequence, we also get : 

1 7? 1 77 

^log(Leb(r«(T,e2,^2,iV))) + ^ log^ < j^Ent{CN,e,K) + ^\ogN, 

and we can take successively limits in iV, A'2, £2, A'l, ei, i? to conclude. 

Note that it is not obvious that in general we could have ••■;Xn : Y) < 

X/(Xi,...,X„ : Y). □ 

Theorem 9.9. (1) (Vanishing for one variable) 

for Xi having finite- dimensional approximants. 

(2) (Improved Subadditivity) 

(Xi U ... U X^; X^+i U ... U Xn : Y)+ 

XlmutP^l] : Xm+l U ... U Xn U Y) + XlmutP^m+l', ■■■',^n ■ Xi U ... U X^ U Y), 

X/m«t(^i; •••;Xm;Xm+i; ...;X„ : Y) = xtLtO^i ^ ... UX^iX^+i u ... UXn : Y)+ 
x"™„t(Xi; Xn. : Xn.+i U ... U Xn U Y) + xlLti^m+i; Xn : Xi U ... U Xn. U Y). 

(3) (Improved subadditivity of entropy) 

X/(Xi,X2 : Y) <x/™.t(Xi;X2 : Y)+x/(Xi :X2UY)+x/(X2 :XiUY), 

xi^'''(Xi,X2 : Y) = xL'ut(Xi;X2 : Y) + xi^'''(Xi : X2 U Y) +xr'(X2 : Xi U Y). 

(4) (Agreement with previous definition) 

// Xi are hyperfinite multivariables (more accurately Pi = 1^ then 

(Xi; Xn) < 

(Xorb the sense of |HMU| j. If moreover r^x.^ Xn '^^ extremal then 

(Xi; Xn) — Xorfc(Xi; Xn). 
Proof. (1) Similar to Xorfc- 

(2), (3) These follow from equalities in the corresponding proofs for XMmut- 
(4) After using Theorem 17.3( 6) in case of extremality and relating inequali- 
ties of our variants (proposition I9.10|) . it remains to prove : Xor6(Xi; Xn) < 

Ximut 

(Xi; Xn). 
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We take notations of |HMU| especially Si(A^) (as in lemma 4.2 and definition 
4.1 there) is a sequence approximating the hyperfinite variables Xi in mixed mo- 
ments. We now show that, for every ei,Ki, there exists S,L such that, for every 
e=(ei,e2),e2<^, K = (Ki, K2), > L : 

limsup ^\ogjN.S{N),€i/2,K < limsup -^Ent(CAr,e,A'|-Djv,£,_R'), 
where Cn.c.K = C'Ar,e,K(rXi,...,X„), Dn.^.K = PlUpCN.e.K (8 ... ® PnUpCN,t.K = 

PiCN,e,K <8) ... ® PnCN,<i,K- First, wc usc Jung's Lemma and follow the proof of 
Lemma 4.2 in jHMU]. We can thus take 5,L such that, for all families of sets 
(6i)i=i,...,n oi N xN hermitian matrices, for N large enough, with ^e^) € V^^l (p^t) 
for all i, we have : 

(9-1) lN,0,ei,Ki >lN,S{N),€i/2,Ki ■ 

Moreover, using again lemma [57T] (iil . 

'Ent{CN,e,K\DN,e,K) = Eut (Cat^c^k | S'Ar,e2,K2 ('^)) ^ Eut (ZJiv^e.K | •S'Ar,,:^ .Xs ('^) ) 
> 'El-lt{CN,eM\SN,e2,K2iT)). 

In order to use the definition of Csizar's projection, we have to take a specific 
measure in An,<l,k- Note that we have considered Csizar's projection with respect 
to Si<!,e2,K2ij)j in order to have a measure with support included in a set where 
hyperfinite variables for marginals will be of the form S', for which we can apply 
the relation (|9.ip above. Let 

,^ lE:'grfi(Xi,...,x„,Jv,K,ei) l'^^v■=■'^ 

alN,e,K{^ ) = 0.{bN,e2,K2{T)){^ )■ 

This is a probability measure: since Siq,t2.K2 is an U{N)''^ invariant probability 
we can compute the total mass by integrating the density over unitaries and by 
definition 

'HAr(lf7H'[/*Gr„(X,A,/fi,ei)) = T-C^li^ orb{^l, •••,Xn : S'^ , . .."E!^, N , Ki, Ci)) = jN,E'.ei.Ki- 

From this and since its support is in r/j(Xi, X„, A'^, Xi, ei) we deduce that 
It follows, by definition of C as Csiszar's projection of S, that 

^l^t{CN^e,K\SN.t2,K2) > ^'^^{TN.t.K\SN.t2,K2) = TN,e,K{'^Og{-fN,.,€i,Ki)) 

> 7'A,e,A:(log(7Af,H(7V),ei/2,/fi)) = log(7JV,E:( A),ei /2,Ki ) • 

The second inequality comes from (|9.ip since €2 < 5, K2 > L. This concludes. □ 

9.5. Comparison of the various entropies. Beyond the case of equality in 
the context of [HMU] , we have the following general inequality. 

Proposition 9.10. (Relating Inequalities) 
X/mtit(Xi; X„ : Y) < XMrn«t(Xi; X„ : Y) < Xor6(Xi; Xn : Y) < 0. 

Proof. Negativity comes from negativity of relative entropy. The first in- 
equality follows from Cjv,e,if(r) G AN,e,K{T) C Ajv.ei.Xi (t) (for Ki < K2,ei > £2) 
and our conventions in case this is empty. 

Finally, applying lemma \S7n (i) for any fi G Aj^_fji{T) we get the inequality : 

Ent{pfx\piUpfj, (E) ■ ■ ■ ®PnUpiJL) < Ent{pfj.\Up^). 
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The second inequality follows. □ 
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